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Abstract 

The  proton  prediction  system  (PPS)  is  a  program  developed  at  the  Air  Force  Research  Laboratory  (AFRL)  to  predict 
solar  energetic  (£'>5  MeV)  proton  (SEP)  intensities  at  !  AU  following  solar  flares.  It  is  based  on  average  observed  SEP 
intensity-time  profiles,  peak  intensities,  and  event  durations.  The  input  parameters  arc  solar  flare  peak  or  time-integrated 
X-ray  or  radio  fluxes  and  their  times  of  onsets  and  maxima,  and  solar  flare  locations.  We  do  a  limited  validation  of  the  PPS 
using  78  GOES  solar  X-ray  flares  of  peak  intensity  ^M5  with  well  associated  Ha  flare  locations.  Predicted  peak  proton 
intensities  J(E>  10  MeV)  and  event  onset  and  rise  times  arc  compared  with  SEP  events  observed  by  GOES.  We  also  select 
all  GOES  E>  10  MeV  SEP  events  above  10  proton  flux  units  (pfu)  during  the  same  time  period  to  compare  with  those 
predicted  by  the  PPS.  With  our  M5  X-ray  flare  threshold  the  PPS  yields  approximately  equal  numbers  of  correct 
predictions,  false  predictions,  and  missed  10-pfu  SEP  events. 

©  2006  Elsevier  Ltd.  All  rights  reserved. 
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1.  Introduction 

Solar  energetic  (E>  10  MeV)  protons  (SEPs)  can 
have  deleterious  effects  on  Air  Force  and  civilian 
spacecraft  (Tylka  et  al.,  1997)  and  communications 
systems  and  can  present  serious  hazards  for  astro¬ 
nauts  on  the  missions  to  the  Moon  and  Mars 
envisioned  by  the  NASA  Vision  for  Space  Explora¬ 
tion  (VSE).  Predicting  SEP  events  at  I  AU  is 
therefore  a  necessary  goal  for  mitigating  the  effects 
of  SEPs  on  those  systems  and  missions.  Different 
approaches  have  been  taken  to  predict  SEP  events. 

•Corresponding  author.  Tel.:  +  1  781  3779665; 
fax:  +17813773160. 

E-mail  address:  Stephen. kahler(a  hanscom.af.mil 
(S.W.  Kahler). 


On  the  longer  (3-^10  years)  climatological  scales 
important  for  spacecraft  design,  Gabriel  and  Feyn¬ 
man  (1996)  found  the  differential  distribution  of 
SEP  event  fluences  for  several  SEP  integral  energies 
to  be  well  approximated  by  power  laws.  The  JPL 
proton  fluence  model  (Feynman  et  al.,  2002)  fits 
observed  SEP  event  fluences  of  £*>10  MeV  SEP 
events  to  an  approximate  log-normal  distribution  of 
occurrence  probability,  and  Xapsos  et  al.  (1998) 
have  used  the  maximum  entropy  principle  to  derive 
a  truncated  power-law  distribution  for  peaks  of  SEP 
event  intensities  J(E>  10  MeV).  Recent  SEP  models 
are  included  in  the  European  Space  Agency's 
SPENVIS  system,  which  provides  standardized 
access  for  spacecraft  engineers  to  current  space 
environment  models  (Heynderickx  et  al.,  2005). 
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For  near  real-time  astronaut  activities,  Bayesian 
prediction  methods  (Neal  and  Townsend,  2001)  and 
artificial  neural  networks  (Hoff  and  Townsend, 
2003)  have  used  the  radiological  dose  equivalents 
measured  early  in  SEP  events  to  predict  the  dose 
rate  profiles  during  the  remainders  of  the  SEP 
events.  However,  for  the  manned  missions  of  the 
VSE  it  will  be  necessary  to  use  observations  of  solar 
eruptive  events  to  make  advance  predictions  of  the 
occurrence  of  SEP  events  and  their  intensity-time 
profiles.  An  early  criterion  for  SEP  event  prediction 
was  the  U-shaped  solar  radio  burst,  consisting  of 
two  spectral  peaks,  one  above  and  one  below 
-^2.6  GHz.  U-shaped  bursts  appear  increasingly 
frequently  in  larger  microwave  bursts  and  are  likely 
due  to  gyrosynchrotron  emission  in  the  higher  cm 
range  and  coherent  emission,  such  as  plasma 
emission,  in  the  dm  range  (Nita  et  al.,  2004),  The 
U-shaped  burst  criterion  was  tested  by  Cliver  et  al. 
(1985)  and  found  to  produce  high  rates  (~50%)  of 
false  alarms  and  missed  predictions  of  SEP  events. 
They  concluded  that  a  type  II  or  type  IV  burst,  not 
the  U-shaped  spectrum,  was  the  critical  observable. 
Other  potential  prediction  techniques  for  SEP 
events  are  based  on  their  reported  associations  with 
solar  soft  X-ray  flares  of  relatively  low  temperatures 
(Garcia,  2004a)  and  with  spectral  hardening  for  at 
least  3  min  in  £^20kcV  X-ray  flare  bursts  (Garcia, 
2004b).  Extending  the  predictions  to  well  before 
event  onsets,  Gabriel  and  Patrick  (2003)  have  used 
neural  network  techniques  to  predict  SEP  events 
48  h  in  advance  using^3-h  averages  of  the  detrended 
ratios  (0,5-3  A)/(l-8  A)  of  X-ray  fluxes  observed  by 
the  GOES  satellites. 

The  current  effort  is  to  predict  the  SEP  profiles  at 
any  point  in  space  by  combining  models  of 
propagating  coronal/interplanetary  shocks  either 
with  databases  of  observed  SEP  events  (e.g.,  Lario 
et  al.,  1998;  Aran  et  al.,  2005)  or  with  models  of 
shock  acceleration  and  propagation  of  SEPs  (e,g., 
Sokolov  et  al.,  2004;  Spence  et  al.,  2004;  Manchester 
et  al.,  2005). 

Two  similar  empirical  systems  for  prediction  of 
SEP  events  are  employed  in  the  US.  Both  reflect 
their  heritage  of  the  1970s,  when  solar  active-region 
flares  were  believed  to  be  the  sources  of  SEPs.  The 
Space  Environment  Center  of  the  National  Oceanic 
and  Atmospheric  Administration  (NOAA)  in 
Boulder,  Colorado,  uses  PROTONS,  a  program 
which  takes  a  flare  soft  X-ray  burst  “half-power” 
fluence,  Ha  flare  location,  and  metric  type  II/IV 
radio  burst  occurrence  as  inputs  to  produce  the 


probability  of  occurrence  of  an  associated 
£>10MeV  SEP  event  and  its  predicted  time  and 
peak  intensity  at  maximum  (Heckman  et  al.,  1992). 
PROTONS  was  validated  by  Balch  (1999)  with  a 
databa.se  of  88  SEP  events  of  >10  peak  flux 
(intensity)  units  (pfu:  1  pcm“^s~' sr"’ >  lOMeV) 
and  associated  flares;  a  second  database  of  1334 
X-ray  flares  of  >M1  peak  flux,  with  which  SEP 
events  did  not  occur,  constituted  a  control  set. 
Significant  discrepancies  with  observations  were 
found  for  the  predicted  peak  intensities  and  rise 
times,  which  were  mitigated  by  selecting  best  fits 
between  the  predicted  and  observed  values. 

2.  The  proton  prediction  system  (PPS) 

The  subject  of  this  work  is  the  second  empirical 
SEP  prediction  system,  the  proton  prediction 
system  (PPS),  developed  by  Smart  and  Shea  (1979, 
1989,  1992)  to  use  solar  flare  observations  to  predict 
the  occurrence,  timing,  intensities,  spectra,  and 
elemental  composition  of  £>  5,  10,  and  50MeV 
SEP  events  at  1  AU,  and  other  SEP  applications 
such  as  terrestrial  radiation  dose  rates  and  iono¬ 
spheric  absorption.  The  PPS  is  based  on  correla¬ 
tions  between  the  properties  of  a  large  number  of 
SEP  events  observed  with  the  IMP  satellites  and 
their  associated  solar  flare  signatures.  It  differs  from 
PROTONS  primarily  by  not  using  the  metric  type 
Il/IV  radio  burst  occurrence  as  an  input  and  in  not 
producing  a  probability  of  occurrence  of  a  SEP 
event.  In  addition,  PROTONS  and  PPS  use 
different  algorithms  to  calculate  the  SEP  intensities. 

In  the  PPS,  SEPs  are  assumed  to  be  accelerated  in 
solar  flares  and  injected  into  interplanetary  mag¬ 
netic  fields  0.25  h  after  flare  onsets.  A  time-invariant 
longitudinal  SEP  intensity  gradient  of  a  factor  of 
~10  per  radian  from  the  flare  location  is  assumed. 
For  observations  at  1  AU,  the  PPS  uses  the 
heliographic  location  of  the  flare  to  calculate  Tma*) 
the  rise  time  of  the  SEP  event  to  maximum  intensity 
relative  to  the  flare  onset  time.  For  £>10  MeV 
protons  the  equation  is  (Smart  and  Shea,  1979) 

7’ma*(h)  =  ^x0'-H2.7,  (1) 

where  &  is  Ihe  longitudinal  angular  displacement  in 
radians  of  the  flare  site  from  the  Earth’s  magnetic 
footpoint,  which  is  taken  as  W57  J""  for  an  assumed 
solar  wind  speed  of  404 kins”',  A ^6  for  flares  east 
of  W573"*  and  ranges  from  6  to  1 2  for  flares  west  of 
W57.3'',  The  convective  westward  displacement  of 
the  symmetric  SEP  population  due  to  solar  rotation 
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results  in  those  asymmetne  values  of  A.  If 
y(£>10MeV)  reaches  lOpfu,  then  PPS  gives  that 
time  as  the  onset  time  Totvser*  Both  Tonsei  and  Fniax 
are  given  relative  to  the  X-ray  flare  onset  time. 

The  maximum  of  */(£>  lOMeV)  in  pfu  for  the 
assumed  optimum  flare  connection  at  W57J“  is 
given  by 

J(E>  10  MeV)  =  30.67  x  {Fxiv  x  (2) 

where  Fxw  is  the  GOES  peak  1-8  A  X-ray  flare  flux 
in  ergscm”^s“*  and  AT  is  the  X-ray  flare  rise  time 
from  onset  to  peak  in  min,  or  by 

J(E>  10  MeV)  =  347  x  (3) 

where  Fy  is  the  GOES  1-8  A  X-ray  flare  half-power 
fluence  in  Jem”^, 

PPS  is  a  part  of  the  AFRL  Geospacc  prediction 
system  (Hilmer  et  ah,  2002)  and  is  used  by  the  Air 
Force  Weather  Agency  for  predictions  of  SEP 
events.  Despite  its  importance  for  space  weather, 
there  has  not  been  a  systematic  validation  of 
the  PPS. 

3*  The  validation  procedure 

To  validate  the  PPS,  we  first  listed  all  >  M5  X-ray 
flares  observed  by  the  GOES  satellite  for  the  S-year 
period  I997’^200L  We  then  selected  only  those  for 
which  an  Ha  flare  location  was  given  in  Solar- 
Geophysical  Data  reports,  requiring  at  least  a  class 
I  Hse  flare  with  an  onset  and/or  maximum  within  the 
X-ray  flare  time  interval.  TTiis  resulted  in  a  total  of 
101  solar  flares.  For  each  flare  wc  ran  PPS  using 
both  options  of  Fxiv  and  AT  (Eq.  (2))  and  of  £jt 
(Eq.  (3))  to  predict  the  peak  GOES  J(£>10MeV) 
intensities.  To  compare  with  GOES  SEP  observa¬ 
tions,  wc  distinguish  three  peak  J(£>  lOMeV)  SEP 
classes:  no  SEP  event,  /<03pfu,  which  is  approxi¬ 
mately  twice  the  GOES  0.1 5  pfu  background;  small 
SEP  events,  0.3pfu<J<  lOpfu;  and  NOAA  SEP 
events,  10  pfu.  Table  I  indicates  the  importance 
of  the  solar  flare  longitude  for  the  PPS  predictions. 


Table  I 

PPS  Predicted  /(£>10MeV)  SEP  event  class  by  solar  hemi¬ 
sphere  for  ^M5  flares,  1997-2001 


SEP  Event  class 

Peak  Flux  (J  in  pfu) 

East 

West 

Total 

No  SEP 

<0.3 

28 

0 

28 

Small  SEP 

0.3-10 

16 

13 

29 

NOAA  SEP 

>10 

4 

40 

44 

Total 

48 

53 

101 

A  small  or  NOAA-class  SEP  event  was  predicted 
for  all  53  western  hemisphere  flares,  but  for  only  20 
of  the  48  eastern  hemisphere  flares.  This  result 
reflects  the  strong  longitudinal  intensity  gradient 
used  in  the  PPS. 

3.  L  PPS  predict iom  of  SEP  peak  inJermties 

Wc  compared  the  PPS  predictions  with  GOES 
£>10  MeV  proton  observations  after  each  flare.  The 
presence  of  previous  or  immediately  following  SEP 
events  limited  the  useful  PPS  test  cases  to  78  of  the 
101  solar  flares.  Although  they  can  be  serious 
radiation  hazards  (Reames,  1999),  PPS  does  not 
predict  the  £>  10  MeV  peaks  often  seen  during  the 
i  AU  shock  appearances.  We  therefore  used  earlier 
GOES  peak  intensities  and  tinn^  for  some  events  al'tcr 
subtracting  off  the  shock  peak  profiles.  The  shock  list 
of  the  ACE  spacecraft  at  http://www.hartol,udeLedu/ 
"-chuck/acc/ACElists/obs_list.html#shocks  was  used 
to  detennine  the  times  of  shocks  at  1  AU, 

We  first  compared  logs  of  observed  GOES  peak 
SEP  intensities,  modified  for  shocks,  with  those  of 
the  78  PPS  predictions  using  the  Fxw  and  the  Fx 
input  options.  Only  33  observed  SEP  events  were 
found  for  the  78  cases;  in  the  remaining  cases  the 
GOES  background  value  was  used.  The  correlation 
coefficient  r  =  0.55  for  the  Fxw  pr^ictions  shown 
in  Fig,  U  r  =  0.50  for  the  Fx  predictions.  We 
therefore  continued  the  analysis  of  the  PPS  predic¬ 
tions  for  J(£>  10  MeV)  using  only  the  Fjrit-  option. 
Fig.  1  shows  that  differences  between  the  PPS  and 


LOG  PPS  INTENSITY  (PFU) 


Fig.  L  Comparison  of  the  GOES  peak  /(£'>l0MeV)  SEP 
intensities  with  the  PPS  predictions  using  78  flares.  The  I  -8  A  X- 
ray  peak  fluxes  and  rise  times  AT  were  inputs  to  the  PPS, 
The  correlation  coefficient  r  =  0,55.  The  line  is  the  least-squares 
best  fit,  and  the  GOES  values  at  logZ  =  -0.82  correspond  to  the 
GOES  background  at  J  =  0,l5pcm”^sr"‘  s“^ 
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GOES  peak  SEP  intensities  can  range  over  several 
orders  of  magnitude. 

3J.  PPS  predictions  of  SEP  and  F  onset 

For  each  of  the  33  observed  SEP  events  Ave 
determined  the  log  of  the  observed  Fmax  and  plotted 
that  value  against  the  log  of  the  predicted  F^ax  of 
the  PPS  in  Fig,  2,  We  find  a  correlation  of  r  =  0J6 
with  a  significance  of  96%  (Bevington  and  Robin¬ 
son,  2003).  If  a  PPS  predicted  intensity  exceeded 
lOpfu,  then  Fon^t  at  the  lO-pfu  threshold  and  the 
duration  of  the  event  above  lOpfu  were  also 
predicted.  For  the  25  cases  with  predicted  NOAA 
SEP  events  we  compare  the  predicted  and  observed 
F onset  values  in  the  log-log  plot  of  Fig,  3,  There  is 
no  significant  correlation  for  that  plot, 

i.i,  PPS  prediciiom  of  NOAA  SEP  events 

The  NOAA  SEP  events  with  peaks  of  /^lOpfu, 
of  most  concern  for  space  weather  effects,  are  posted 
at  http://umbra.nascom.nasa,gov/SEP/seps,html. 
There  are  50  10-pfu  events  on  the  NOAA  list  during 
1997-2001.  We  added  two  previously  unlisted  SEP 
events  that  occurred  during  high  {>  lOpfu)  GOES 
intensities  and  subtracted  seven  SEP  events  for 
which  only  the  shock  peaks  exceeded  lOpfu,  The 
resulting  45  SEP  events  were  compared  with  the  PPS 
predictions.  The  question  here  is  how  well  the  PPS 
predicts  the  occurrence  of  NOAA  SEP  events, 
regardless  of  peak  SEP  intensities.  We  classified  the 
GOES  SEP  observations  and  the  78  PPS  predictions 


LOG  PPS  RISE  TIME  {HRS) 

Fig.  2,  Comparison  of  PPS  and  observed  GOES  SEP  event  rise 
times  (times  from  X-ray  flare  peaks  to  SEP  peaks)  for  the  33 
cases  with  observed  events.  The  correlation  coefficient  r  =  0,36, 
with  a  96%  significance. 


Fig.  3.  Comparison  of  onset  times  FonKt  (from  X-ray  flare  peaks 
to  times  when  J  reaches  lOpfu)  for  the  25  cases  for  which  PPS 
predicts  a  NOAA  class  SEP  event.  The  least*squares  best-fit  line 
is  shown,  but  the  PPS  predictions  are  not  significantly  correlated 
with  the  GOES  observations. 

into  the  following  four  groups,  where  the  bold  font 
indicates  incorrect  PPS  predictions: 


NOAA  events  predicted:  18 

Null  events  predicted:  39 

NOAA  events  missed:  3 

False  NOAA  events  predicted:  18 

Total  PPS  predictions:  78 


Thus,  based  only  on  prediction  of  NOAA  SEP 
events,  the  PPS  was  correct  in  =  73%  of  the  time. 
However,  another  45  —  18  —  3  =  24  NOAA  SEP 
events  were  not  predicted  by  the  PPS  because  it  was 
not  run;  for  each  of  those  cases  no  appropriate  X- 
ray  and  Hx  flare  was  found.  The  best  candidate  flare 
associations  for  those  SEP  events  were  distributed 
in  X-ray  intensities  as  follows: 

Class  <M1  flares:  11 

Class  M1-M5  flares:  10 

Class  ^M5  flares:  3 

The  3^M5  flares  were  not  run  in  PPS  because 

suitable  Hoc  flares  were  not  reported.  The  SEP  event 
and  X20  flare  on  2001  April  2,  during  a  time  of  no 
Ho£  flare  patrol,  is  the  most  egregious  case  of  that 
group.  Using  various  solar  flare  data  sets,  we 
determined  that  22  of  these  24  flares  not  run  in 
PPS  occurred  in  the  western  hemisphere, 

3.4.  PPS  predictions  and  HAFv.2  model  flares 

As  mentioned  in  Section  2,  the  PROTONS 

predictions  differ  from  those  of  the  PPS  in  using 
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the  occurrence  of  type  IT  and/or  type  TV  metric 
radio  bursts  as  one  factor  to  predict  the  probability 
of  occurrence  of  a  SEP  event.  Can  we  use  type  11 
metric  radio  events  to  improve  the  PPS  accuracy? 
We  examine  this  possibility  by  comparing  our  PPS 
events  with  those  used  in  a  study  of  the  Hakama- 
da-Akasofu-Fry  version  2  (HAFv,2)  model  of 
interplanetary  shocks  (Fry  et  al.,  2003).  The  model 
inputs  require  coronal  shock  speeds  determined 
from  metric  type  II  bursts  that  occurred  when  X-ray 
observations  were  available  in  real  time.  Forty-six 
of  our  78  PPS  events  coincided  with  those  of  the 
HAFv.l  study,  and  a  correct  NOAA  event  predic¬ 
tion  was  made  in  =  67%  of  those  cases.  The 
remaining  PPS  events,  with  no  matching  HAFv.2 
study  events,  were  correct  26/32  ^  82%  of  the  time, 
but  this  high  number  was  due  to  the  23  cases  in 
which  the  null  events  were  correctly  predicted.  The 
main  effect  of  adding  a  requirement  for  type  11 
bursts  to  PPS  would  therefore  probably  be  to 
eliminate  these  latter  cases. 

Wc  can  further  examine  the  shock  speeds  of  the  46 
HAFv.2  events  with  PPS  predictions.  The  type  II 
burst  median  shock  speed  for  the  18  HAFv,2  events 
with  NOAA  SEP  events  was  1300kms^^;  for  the  28 
events  without  NOAA  SEP  events  it  was  907  km  s”*. 
However,  within  each  of  these  groups  the  median 
speeds  of  the  two  subgroups  correctly  and  incorrectly 
predicted  by  the  PPS  were  very  similar,  suggesting 
that  the  PPS  predictions  would  not  be  improved  by 
considering  the  type  II  burst  shock  speeds. 

4*  Discussion 

The  logs  of  peak  J{£>10MeV)  SEP  intensities 
predicted  by  the  PPS  are  correlated  with  those 
observed  by  GOES  (Fig.  1),  but  the  intensities  show 
several  orders  of  magnitude  in  scatter.  The  SEP 
and  predictions  (Figs.  2  and  3)  are 

worse.  The  peak  SEP  intensity  correlation  of  r  = 
0  J5  for  PPS  is  comparable  to  that  of  0.455  found  by 
Balch  (1999)  for  PROTONS,  but  his  SEP  intensity 
validation  test  consisted  of  running  PROTONS  for 
88  known  NOAA  SEP  events  while  we  used  for  PPS 
a  database  of  78  large  solar  flares,  only  21  of  which 
were  associated  with  NOAA  SEP  events.  We  find  a 
much  lower  correlation  (r  =  0.36)  for  the  33  PPS 
predicted  than  did  Balch  (1999)  (r  =  OJl)  for 
his  88  PROTONS  events.  Again  there  are  significant 
differences  between  the  two  studies.  We  used  logs  of 
Tniax  and  Balch  (1999)  used  linear  (his  in 
his  correlation.  For  of  his  Eq.  (20)  Balch  (1999) 


finds  significant  differences  from  our  equivalent 
Eq.  (1),  in  particular,  the  earliest  /rise  occurs  at 
W78°;  PPS  takes  W56''  for  that  longitude, 

A  critical  aspect  of  the  PPS  is  the  scaling  power- 
law  exponents  of  Eqs.  (2)  and  (3),  which  take  X-ray 
fluences,  either  Fxw  x  AT  or  Fx^  respectively,  as 
inputs.  Recently,  Belov  et  al.  (2005)  have  compared 
peak  J{E>  10  MeV)  SEP  intensities  with  associated 
X-ray  peak  fluxes  Fyw  for  well  connected  SEP 
events  over  a  28- year  period.  They  found  a  best- fit 
scaling  of /(£>  10  MeV)-(F;ru^V  To  relate 

their  result  to  Eqs.  (2)  and  (3),  we  first  note  that  a 
log-log  plot  of  AT  versus  Fxw  for  the  lOl  ^M5  X- 
ray  events  of  this  study  shows  no  correlation,  i.e., 
that  AFdocs  not  scale  with  Fxw-  This  suggests  that 
to  first  order  we  can  directly  compare  the  Belov  ct 
ai.  (2005)  Fxw  exponent  of  1.14  to  the  fiuence 
exponents  of  Eqs.  (2)  and  (3);  their  Fxw  exponent  is 
slightly  smaller  than  the  former  (1323),  larger  than 
the  latter  (0.941),  and  larger  than  the  best-fit  (0,82) 
deduced  by  Balch  (1999)  in  his  Eq,  (17).  Given  the 
large  scatter  evident  in  Fig.  I,  the  differences  in 
exponents  do  not  appear  significant. 

The  limitations  of  this  PPS  validation  arc  con¬ 
siderable.  First,  we  have  tested  only  the  £>  10  MeV 
proton  option,  and  not  the  £>5  and  £>50McV 
proton  or  other  options  of  the  PPS.  Second,  other 
input  flare  vanables  could  have  been  used.  We  used 
flare  X-ray  peak  fluxes  Fxw  (Etj.  (2))  rather  than 
fluences  Fx^  although  the  former  require  the  X-ray 
rise  tim^  AT  and  therefore  have  dimensions  of 
fluencc.  Wc  did  not  lest  flare  microwave  bursts. 
Because  flare  X-ray  and  microwave  intensities  arc 
generally  correlated  (e.g.,  Benz  and  Gucdel,  1994), 
we  would  not  expect  a  significant  dilTerencc  in  the 
PPS  results  if  microwave  parameters  had  been  used 
in  place  of  the  soft  X-rays  the  GOES.  Third,  wc  have 
not  considered  the  durations  or  fluences  of  the  SEP 
events  although  these  are  also  output  parameters 
(Smart  and  Shea,  1979;  Hilmer  et  al.,  2002).  Fourth, 
the  PPS  SEP  energy  spectra  were  not  examined. 
Because  of  variations  of  characteristic  “knee” 
energies  among  SEP  event  spectra  (Tylka,  2001), 
the  quality  of  the  PPS  predictions  may  be  very  energy 
dependent. Finally,  MS  X-ray  flare  threshold  was  an 
arbitrary  choice  for  the  PPS  validation.  A  lower 
X-ray  threshold  would  obviously  increase  the  num¬ 
ber  of  correct  SEP  event  predictions,  but  only  at  the 
expense  of  more  false  predictions.  Conversely,  a 
higher  X-ray  threshold  would  decrease  the  number  of 
false  predictions  at  the  cost  of  more  missed  predic¬ 
tions.  Wc  have  not  attempted  to  optimize  this  trade- 
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ofT,  but  M5  may  be  a  fortuitous  choice.  In  comparing 
long-term  monthly  occurrences  of  SEP  events  and 
X-ray  flares  over  a  range  of  peak  X-ray  flux 
thresholds,  Belov  et  al.  (2005)  found  a  maximum 
correlation  for  ^M5  flares,  as  we  used  here. 

To  summarize  this  PPS  validation  for  the  NOAA 
lOpfu  events,  we  And  roughly  equal  numbers  of 
correct  predictions  (18),  false  predictions  (18),  and 
missed  predictions  (27).  We  suggest  these  numbers 
as  a  current  standard  against  which  results  of  future 
SEP  event  prediction  models  should  be  compared. 
If  we  include  the  addition  of  the  correct  predictions 
of  null  events  (39)  in  a  formal  success  criterion,  then 
the  PPS  success  rate  is  (18  +  39)/(78  +  24)  =  56% 
(Section  3.3). 

The  basic  PPS  assumption  of  solar  flare  sources 
for  the  SEP  events  and  the  fact  that  the  PPS  and 
PROTONS  have  endured  over  three  decades  as  our 
best  SEP  prediction  tool  is  testimony  to  the 
embarrassingly  poor  progress  made  in  this  crucial 
area  of  space  weather  forecasting.  Wc  can  be 
encouraged  that  we  have  recently  gained  new 
insights  into  particle  acceleration,  particularly  at 
shocks  driven  by  coronal  mass  ejections  (CMEs) 
(e.g.,  Gopalswamy  et  al.,  2004;  Cliver  et  aL,  2005). 
On  the  horizon  are  models  capable  of  using  solar 
and  CME  observations  to  calculate  shock  propaga¬ 
tion  and  SEP  acceleration  and  propagation  to  1  AU 
(Sokolov  et  ah,  2004;  Kota  et  al.,  2005).  However, 
we  can  be  optimistic  about  those  models  only  after 
successful  validation  that  shows  a  performance 
superior  to  that  of  the  standard  PPS  and  PRO¬ 
TONS.  Until  that  time  SEP  events  will  remain  a 
serious  concern  for  the  execution  of  the  VSE. 
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